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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 



Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )□ Responsive to communication(s) filed on . 

2a)D This action is FINAL. 2b)S This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quay/e, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1-8 and 13 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) E3 Claim(s) 1-8 and 13 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)^ The drawing(s) filed on 22 March 2004 is/are: a)S accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
1 1 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-1 52. 

Priority under 35 U.S.C. § 1 19 

12)D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. Q Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1 ) S Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-41 3) 

2) □ Notice of Drattsperson's Patent Drawing Review (PTO-948) Paper No(s)/Mail Date. . 

3) □ Information Disclosure Statement(s) (PTO-1 449 or PTO/SB/08) 5) □ Notice of Informal Patent Application (PTO-1 52) 

Paper No(s)/Mail Date . 6) □ Other: . 

U.S. Patent and Trademark Office ~~ —— - — — -— — — 

PTOL-326 (Rev. 7-05) Office Action Summary Part of Paper No./Mail Date 20060401 
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DETAILED ACTION 



Specification 

1 . The disclosure is objected to because of the following informalities: 

Examiner notes cross-referenced Applications with no application numbers (p. 1, 

paragraphs 7, 8, and 9 "[Ser. No. and filing date TBA]") in the specification. 

Examiner notes that 09/691 ,795 has been patented. The proper U.S. Patent 

number should be added to the information in paragraph 6 on page 1 of the 

specification. 

Appropriate correction is required. 



Claim Rejections - 35 USC §112 

2. The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

Claims 3, 4, and 5 each recite the limitation "wherein the information" in line 1 
of each claim. 

There is insufficient antecedent basis for this limitation in the claim. 



Claim Rejections - 35 USC § 102 
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3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 



4. Claims 1-5 are rejected under 35 U.S.C. 102(e) as being anticipated by Dahlin 
et al. (U.S. Pat. Pub. No. 2004/0078215) (Systems and Methods for Documenting 
medical Findings of a Physical Examination). 

4.1 Regarding claim 1 , Dahlin discloses a method for annotating an item in a user 
interface of a media production system (paragraph 27 "electronic media"), the method 
comprising: 

accepting signals from a user input device to select a part of a production being 
processed by the media production system (Abstract "recording a text annotation, 
recording a graphical annotation, recording a sound annotation, and recording a 
photographic annotation"; ); 

creating annotation information (Abstract; paragraphs 91, 92, 100); and 
storing the annotation information in association with the selected part of the 
production (Figs. 22, 25; paragraph 92 'When the user indicates annotation is complete, 
the annotation is stored by the system and is linked to the location."; paragraph 107). 
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4.2 Per claim 2, Dahlin teaches the method of claim 1 , further comprising accepting 
signals from a user input device to create the annotation information (Abstract "means 
for recording an annotation"; paragraph 19 "input interface"). 

4.3 Regarding claim 3, Dahlin discloses the method of claim 2, wherein the 
information includes text information (Abstract "text annotation"; paragraph 100 
"depending on the type of annotation (free text, voice, drawing, and additional selected 
options) that the annotation contains"). 

4.4 Per claim 4, Dahlin teaches the method of claim 2, wherein the information 
includes capture of drawing information (Abstract "recording a graphical annotation"; 
paragraph 17 "free-form input of text and graphics"; paragraph 95 "free-form graphic 
annotations"; paragraph 100 "depending on the type of annotation (free text, voice, 
drawing, and additional selected options) that the annotation contains"; paragraph 106 
"free-hand drawing"). 

4.5 Regarding claim 5, Dahlin discloses the method of claim 2, wherein the 
information includes audio information (Abstract "recording a sound annotation"; 
paragraph 91 "audio recording"; paragraph 100 "depending on the type of annotation 
(free text, voice, drawing, and additional selected options) that the annotation 
contains"). 
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5. Claims 1 - 3 and 6 - 8 are rejected under 35 U.S.C. 102(e) as being anticipated 
by Matsuzawa et al (U.S. Pat. No. 6,085,185) (Retrieval Method and System of 
Multimedia Database). 

5.1 Regarding claim 1 , Matsuzawa discloses a method for annotating an item in a 
user interface of a media production system, the method comprising: 

accepting signals from a user input device to select a part of a production being 
processed by the media production system (Abstract "When a user puts an annotation 
to a specific range of a medium"; col. 2, lines 28 - 31 "A user often desires to give 
comment information (hereinafter referred to as an annotation) ..." for a specific range 
of video and audio data."; col. 6, lines 1 1 - 24 "specific range"); 

creating annotation information (Figs. 1 , 7; Abstract; col. 2, lines 28 - 37; col. 7, 
lines 58 - 64); and 

storing the annotation information in association with the selected part of the 
production (Fig. 1 ; Abstract; "When a user puts an annotation to a specific range of a 
medium, the system registers an annotation object comprising the object ID of the target 
medium, specific range, and annotation information in a table ... "; col. 4, lines 15-31). 

5.2 Per claim 2, Matsuzawa teaches the method of claim 1 , further comprising 
accepting signals from a user input device to create the annotation information (Fig. 1 , 
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items 30, 40; Abstract "user puts an annotation to a specific range of a medium"; col. 
2, lines 28 - 37 "user often desires to give comment information (hereinafter referred to 
as an annotation) ..."; col. 7, lines 58 - 64 "In the annotation setting process, the screen 
for inputting the annotation information is displayed on the display device 40 ..."). 

5.3 Regarding claim 3, Matsuzawa discloses the method of claim 2, wherein the 
information includes text information (Fig. 4; col. 2, lines 54 - 64 "text"; col. 6, lines 31 - 
38 "text is used as an annotation"). 

5.4 Per claim 6, Matsuzawa teaches the method of claim 1 , wherein the annotation 
information is automatically generated by a process executing on a digital system (col. 
6, lines 39-44 "the annotation object 710 is automatically generated for all 
destination/source objects in the citation relation to the range."; col. 13, lines 9-16; col. 
16, lines 63 - 67 "an annotation object is automatically generated for a specific range 
in the link relation to all media objects including the media object thereof, labor saving 
for the registration work of annotation objects is realized."). 

5.5 Regarding claim 7, Matsuzawa discloses the method of claim 6, further 
comprising wherein the annotation information is automatically generated at a 
predetermined time (col. 1 3, lines 9-16 "when a user uses a part of a media object as 
a component of another media object in the editing work and when an annotation object 
is already defined for the portion of the citation source object (source object), 
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automatically generating an annotation object for the citation destination object 
(destination object) at the same time by diverting the annotation object.") 

5.6 Per claim 8, Matsuzawa teaches the method of claim 6, further comprising 
wherein the annotation information is automatically generated upon the occurrence of a 
predetermined event (col. 13, lines 9-16 "when a user uses a part of a media object 
as a component of another media object in the editing work and when an 
annotation object is already defined for the portion of the citation source object 
(source object), automatically generating an annotation object for the citation 
destination object (destination object) at the same time by diverting the annotation 
object.") 

6. Claim 1 - 3 and 13 is rejected under 35 U.S.C. 102(e) as being anticipated by 
Klemets et al. (U.S. Pat. No. 6,449,653) (Interleaved Multiple Multimedia Stream for 
Synchronized Transmission over a Computer Network). 

6.1 Regarding claim 1 , Klemets discloses a method for annotating an item in a user 
interface of a media production system (paragraph 27 "electronic media"), the method 
comprising: 



Application/Control Number: 10/807,474 Page 8 

Art Unit: 2141 

accepting signals from a user input device to select a part of a production being 
processed by the media production system (Abstract; Figs. 2, 3A, 3B, 6, 7; col. 4, lines 
36 - 65); 

creating annotation information (Abstract; Figs. 2, 3A, 3B, 6, 7; col. 4, lines 36 - 
65); and 

storing the annotation information in association with the selected part of the 
production (Abstract; Figs. 2, 3A, 3B, 6, 7; col. 4, lines 36 - 65). 

6.2 Per claim 2, Klemets teaches the method of claim 1 , further comprising accepting 
signals from a user input device to create the annotation information (Abstract; Figs. 1, 
2, 3A, 3B; col. 4, lines 18-24 and 36 - 65). 

6.3 Regarding claim 3, Klemets discloses the method of claim 2, wherein the 
information includes text information (Figs. 6, 7). 

6.4 Regarding claim 13, Klemets discloses a method for providing control of an 
application executing on a first digital system at a first location to a user of a second 
digital system at a second location, wherein the first and second digital systems are 
coupled by a communication link wherein the application includes a user interface 
control to modify a parameter, wherein the first and second digital systems include first 
and second user input devices, respectively the method comprising: 
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accepting signals from the first user input device to associate the user interface 
control with the second user input device (Figs. 2, 3A, 3B "Producer" "Designer"; 
Abstract; col. 4, lines 36 - 65); and 

accepting signals generated by the second user input device at the first digital 
system to modify the parameter (annotate) (Figs. 2, 3A, 3B "Producer" "Designer"; 
Abstract; col. 4, lines 36 - 65). 



Conclusion 

7. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Katz et al. U.S. Pat. No. 5,404,295 Method and Apparatus for Utilizing 
Annotations to Facilitate Computer Retrieval of Database Material 
Annotating mechanism that includes automatically of semi-automatically generating 
annotations. 

Foote et al. U.S. Pat. No. 6,404,925 Methods and Apparatuses for 
Segmenting an Audio-Visual Recording Using Image Similarity Searching and Audio 
Speaker Recognition 

Multimedia annotating mechanism that automatically generates annotations. 

Chen et al. U.S. Pat. No. 6,307,550 Extracting Photographic Images from 
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Video 

Annotating mechanism that automatically generates text annotations. 

8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Kenneth R. Coulter whose telephone number is 571 
272-3879. The examiner can normally be reached on 5 4 9. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Rupal Dharia can be reached on 571 272-3880. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 

KENNETH R. COULTER 



krc 




